Using Markov Chains to Reduce Randomness

نویسنده

  • Daniel Grier
چکیده

1 Useful Linear Algebra Let v = (v1, v2, . . . , vn) be a non-zero n-dimensional row vector and P an n× n matrix. • We say v is an eigenvector of P with corresponding eigenvalue λ iff vP = λv. • The L1-norm of v (denoted ‖v‖1) is ∑n i=1 vi. • The L2-norm of v (denoted ‖v‖2) is √∑n i=1 v 2 i . • The inner product of two vectors v and w (denoted v ·w) is ∑n i=1 viwi. • We say vectors v,v, . . .v are orthonormal iff v · v = { 1 if i = j 0 if i 6= j Suppose P is an n × n matrix with positive entries, eigenvectors v,v, . . . ,v, and eigenvalues λ1, λ2, . . . , λn. Let α ∈ R. Using the above definitions we derive the following facts: Fact 1 αP has eigenvectors v,v, . . . ,v and eigenvalues αλ1, αλ2, . . . , αλn Proof v(αP ) = α(vP ) = αλiv . Fact 2 P + I has eigenvectors v,v, . . . ,v and eigenvalues λ1 + 1, λ2 + 1, . . . , λn + 1 Proof v(P + I) = vP + vI = λiv (i) + v = (λi + 1)v .

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Empirical Bayes Estimation in Nonstationary Markov chains

Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical  Bayes estimators  for the transition probability  matrix of a finite nonstationary  Markov chain. The data are assumed to be of  a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...

متن کامل

Quantum Simulation of Markov Chains

The possibility of simulating a stochastic process by the intrinsic randomness of quantum system is investigated. Two simulations of Markov Chains by the measurements of quantum systems are proposed.

متن کامل

The Rate of Rényi Entropy for Irreducible Markov Chains

In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.

متن کامل

Evaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes

Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded  DNA virus. There were two approaches for prediction of each Markov Model parameter,...

متن کامل

The Randomness Recycler Approach to Perfect Sampling

1. The Randomness Recycler versus Markov chains At the heart of the Monte Carlo approach is the ability to sample from distributions that are in general very difficult to describe completely. For instance, the distribution might have an unknown normalizing constant which might require exponential time to compute. In these situations, in lieu of an exact approach, Markov chains are often employe...

متن کامل

Cluster-Based Image Segmentation Using Fuzzy Markov Random Field

Image segmentation is an important task in image processing and computer vision which attract many researchers attention. There are a couple of information sets pixels in an image: statistical and structural information which refer to the feature value of pixel data and local correlation of pixel data, respectively. Markov random field (MRF) is a tool for modeling statistical and structural inf...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014